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Abstract 


Introduction:  This  report,  along  with  its  knowledge  database  tool,  represents  completion  of  Task 
5  of  the  work  stream  “Research  Using  in  Vivo  Simulation  of  Meta-Organizational  Shared 
Decision  Making  (SDM)”,  one  component  of  the  Technology  Innovation  Fund  (TIF)  program  on 
Meta-organizational  Collaboration  that  has  been  designed  to  assist  in  understanding  challenges 
faced  by  the  Canadian  Forces  (CF).  The  objective  of  the  stream  is  to  conduct  basic  research  into 
shared  decision  making  through  the  analysis  of  case  studies,  exercises  and  simulations. 

Method:  Task  5  involved  the  development  of  a  knowledge  database  tool  organised  by  the  various 
components  of  the  shared-decision  making  (SDM)  framework  entitled  Model  of  Inter- 
Organizational  Problem  Solving.  The  database  tool  purpose,  organization  and  features  are 
described  in  this  report. 

Results  and  Discussion:  During  research  undertaken  to  develop  the  Model  for  Inter- 
organizational  Problem  Solving  (Task  1)  and  the  design  and  implementation  of  an  experimental 
plan  to  test  the  Model  (Tasks  2  and  3),  a  body  of  literature  was  collected  and  referenced  in  the 
various  Task  reports.  Additional  peer-reviewed  articles  and  grey  literature  were  consulted  for  the 
purpose  of  completing  Task  4:  Modeling  communication  and  decision  making  functions.  This 
knowledge  base  of  information  sources  has  been  organized  in  MS  Access  by  the  key  components 
of  the  Model  for  ease  of  use  by  the  operational  and  analytic  communities  within  DRDC. 

Resume 


Introduction  :  Ce  rapport  presente  la  Tache  5  du  projet «  Recherche  par  la  simulation  in-vivo  sur 
la  prise  de  decision  partagee  des  meta-organisations  »,  une  composante  du  programme  de 
recherche  sur  les  meta-organisations  finance  par  le  Fond  pour  F innovation  technologique 
(Technology  Innovation  Fund  -  TIF),  mis  en  place  afm  d’ameliorer  la  comprehension  des  defis 
auxquels  font  face  les  Forces  canadiennes  (FC)  en  matiere  de  collaboration  inter- 
organisationnelle.  L’objectif  de  ce  projet  est  de  mener  une  recherche  fondamentale  sur  la  prise  de 
decision  partagee,  au  moyen  d’etudes  de  cas,  d’exercices  et  de  simulations. 

Methode  :  La  Tache  5  consiste  en  la  creation  d’un  outil  de  connaissance  sous  forme  de  base  de 
donnees  organisee  selon  les  elements  du  modele  de  prise  de  decision  partagee  nomme  Modele  de 
la  resolution  inter-organisationnelle  de problemes.  L’objectif,  la  structure  ainsi  que  les 
caracteristiques  de  cet  outil  sont  decrits  dans  ce  rapport. 

Resultats  et  discussion  :  Au  cours  de  la  recherche  entreprise  dans  le  but  de  developper  le  Modele 
de  la  resolution  inter-organisationnelle  de  problemes  (Tache  1)  et  la  conception  ainsi  que  la  mise 
en  oeuvre  du  plan  experimental  servant  a  tester  le  Modele  (Taches  2  et  3),  un  important  coipus  de 
litterature  a  ete  recueilli  et  cite  dans  les  rapports  des  differentes  Taches.  Des  articles  scientifiques 
additionnels  et  des  rapports  ont  ete  consultes  afm  de  completer  la  Tache  4  intitulee  :  Modelisation 
des  fonctions  de  communication  et  de  prise  de  decision.  Ces  sources  d’information  ont  ete 
organisees  dans  le  logiciel  MS  Access  d’apres  les  composantes  cles  du  Modele,  de  maniere  a 
pouvoir  etre  facilement  consultees  et  manipulees  par  le  personnel  de  RDDC. 
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Executive  summary 


Research  Using  In  Vivo  Simulation  of  Meta-Organizational  Shared 
Decision  Making  (SDM)  -  Task  5:  User  Friendly  Knowledge  Tool 

Louise  Lemyre1  et  al.;  DRDC  CSS  CR  2011-34;  Defence  R&D  Canada  -  CSS. 

Introduction:  This  report  describes  the  MS  Access  knowledge  database  tool  created  for  Task  5 
of  the  project  entitled  Research  Using  in  Vivo  Simulation  of  Meta-Organizational  Shared 
Decision  Making  (SDM),  one  of  the  seven  work  streams  of  the  Technology  Innovation  Fund 
(TIF)  project  that  has  been  designed  and  implemented  to  assist  in  understanding  and  addressing 
the  collaboration  challenges  faced  by  the  Canadian  Forces  (CF).  The  CF  has  become  increasingly 
involved  in  collaborating  with  various  non-traditional  partners  to  find  and  to  implement  solutions 
to  address  complex  problems  both  domestically  and  internationally.  Understanding  inter- 
organizational  decision  making  processes  and  outcomes  thus  becomes  an  important  factor 
towards  improving  interoperability  in  such  a  multi-organizational  environment. 

The  objective  of  Task  5  is  to  provide  the  analytical  and  operational  communities  within  DRDC 
with  easy  access  to  key  information  sources  and  references  linked  to  the  Model  for  Inter- 
organizational  Problem-solving  developed  in  Task  1  of  the  SDM  research  project  and 
implemented  and  tested  under  Tasks  2,  3  and  4. 

Method:  Fleaded  by  Dr.  Lemyre,  the  Gap-Sante  research  team  at  the  University  of  Ottawa 
created  a  Model  for  Inter-organizational  Problem  Solving  under  Task  1  of  the  project.  Task  2 
involved  the  development  of  a  research  plan  for  an  in  vivo  simulation  experiment  as  well  as 
qualitative  interviews.  Task  3  comprised  testing  the  shared  decision-making  (SDM)  framework 
using  qualitative  interviews  with  key  decision  makers  having  played  a  role  in  major  events  and 
testing  an  in  vivo  experimental  simulation  of  shared  decision  making  in  a  complex  scenario.  Task 
4  focused  on  analysing  the  findings  from  the  various  data  sources  and  methods  implemented  in 
previous  tasks  to  develop  potential  considerations  and  guidelines  with  respect  to  communication, 
decision-making  and  problem-solving  in  multi-organizational  environments  during  extreme 
events.  The  present  Task  5  entails  the  creation  of  a  bibliographic  database  in  MS  Access  based  on 
the  various  references  collected  throughout  the  research  process  to  ensure  easy  access  to  salient 
information  and  key  findings  of  the  study. 

Results:  The  final  version  of  the  user  friendly  knowledge  tool  contains  a  total  of  479  references. 
The  database  was  designed  for  users  with  little  knowledge  of  the  MS  Access  software.  In  order  to 
promote  easy  navigation,  the  tool  was  organized  according  to  the  following  7  main  categories 
reflecting  concepts  found  in  the  Model  for  Inter-organizational  Problem-solving:  ‘Problem 
Solving  in  Various  Organisational  Structures’;  ‘Decision-making  Models’;  ‘Problem  Solving 
Approaches’;  ‘Time’;  ‘Resources’;  ‘Complexity’  and  ‘Case  Studies’.  A  total  of  34  pre-defined 
reports  were  created  in  the  database  with  respect  to  these  categories.  Printing  options  are  also 
available. 

Task  5  concludes  the  Research  Using  in  Vivo  Simulation  of  Meta- Organizational  Shared 
Decision  Making  (SDM)  project.  Though  the  database  this  report  refers  to  contains  an  extensive 


1  Dr.  Lemyre  is  the  McLaughlin  Research  Chair  on  Psychosocial  Aspects  of  Risk  and  Health,  Director  of 
GAP-Sante  at  the  Institute  of  Population  Health,  and  Professor  of  Psychology,  Faculty  of  Social  Science, 
University  of  Ottawa 
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number  of  peer-reviewed  articles,  grey  literature  and  other  types  of  references  relating  to  the 
shared  decision-making  (SDM)  framework,  further  research  is  needed  to  fully  understand  the 
implications  of  the  Model. 


DRDCCSS  CR  201 1-34 


Sommaire 


Recherche  sur  le  partage  de  decision  des  meta-organisations  en  utilisant 
la  simulation  in  vivo  -  Tache  5  :  Outil  bibliographique  convivial 

Louise  Lemyre2  et  al.;  DRDC  CSS  CR  2011-34;  R  &  D  pour  la  defense  Canada  -  CSS  . 

Introduction  :  Ce  rapport  decrit  l’outil  bibliographique  convivial  sous  forme  de  base  de  donnees, 
tel  que  constitue  pour  la  Tache  5  du  projet  intitule  ‘  ’Recherche  par  la  simulation  in  vivo  sur  la 
prise  de  decision  partagee  des  metaorganisations" ,  l’un  des  sept  chantiers  du  Fond  pour 
l’innovation  technologique  (Technology  Innovation  Fund  -  TIF),  un  programme  de  recherche 
conqu  et  mis  en  place  afm  d’ameliorer  la  comprehension  des  defis  auxquels  font  face  les  Forces 
canadiennes  (FC)  en  matiere  de  collaboration  interorganisationnelle.  Les  FC  collaborent  de  plus 
en  plus  avec  de  nombreux  partenaires  non  traditionnels  afm  de  trouver  et  de  mettre  en  place  des 
solutions  pour  faire  face  aux  problemes  complexes,  que  ce  soit  au  niveau  national  ou 
international.  Le  fait  de  comprendre  les  processus  ainsi  que  les  resultats  de  prise  de  decision 
interorganisationelle  est  done  un  element  important  pour  ameliorer  l’interoperabilite  dans  un 
contexte  multiorganisationnel. 

L’objectif  de  la  Tache  5  est  de  foumir  au  personnel  operationnel  et  analytique  de  DRDC  un  acces 
direct  a  des  sources  d’ information  cles,  ainsi  qu’a  des  references  bibliographiques  liees  au  Modele 
pour  la  resolution  interorganisationnelle  des  problemes  developpe  lors  de  la  Tache  1  du  projet  de 
recherche  sur  la  prise  de  decision  partagee  et  ainsi  que  mis  en  oeuvre  et  teste  au  cours  des  Taches 
2,  3  et  4. 

Methode  :  Dirigee  par  la  Professeure  Lemyre,  l’equipe  de  recherche  Gap-Sante  de  l’Universite 
d’Ottawa  a  developpe  un  Modele  pour  la  resolution  interorganisationnelle  des  problemes  sous  la 
Tache  1  du  projet.  La  Tache  2  a  consiste  en  la  conception  d’un  plan  de  recherche  concemant  une 
experience  de  simulation  in  vivo,  de  meme  que  des  entrevues  qualitatives.  La  Tache  3  du  projet  a 
eu  comme  objet  de  tester  le  modele  de  prise  de  decision  partagee  par  le  biais  d’ entrevues  avec  des 
preneurs  de  decision  cle  ayant joue  un  role  dans  des  evenements  importants,  ainsi  que  l’utilisation 
d’une  simulation  experimentale  in  vivo  de  prise  de  decision  presentant  un  scenario  complexe.  La 
Tache  4  a  porte  sur  l’analyse  des  resultats  de  recherche  afm  de  developper  des  considerations 
potentielles  et  des  directives  par  rapport  a  la  communication,  la  prise  de  decision  et  la  resolution 
de  problemes  dans  des  milieux  multiorganisationnels  durant  des  evenements  extremes.  La  Tache 
5  presentee  dans  ce  rapport  consiste  en  la  creation  d’une  bibliographie  sous  forme  de  base  de 
donnees  des  diverses  references  recueillies  durant  le  processus  de  recherche.  Get  outil  sert  a 
assurer  un  acces  facile  a  des  informations  saillantes  ainsi  que  des  resultats  de  recherche  cle  de 
T  etude. 

Resultats:  La  version  finale  de  l’outil  bibliographique  convivial  contient  un  total  de  479 
references  bibliographiques.  La  base  de  donnees  a  ete  conque  pour  des  utilisateurs  ayant  peu  de 
connaissance  du  logiciel  MS  Access.  De  maniere  a  favoriser  une  navigation  simple,  l’outil  a  ete 
structure  en  fonction  de  7  categories  principals  rattachees  a  des  concepts  trouves  dans  le  Modele 
pour  la  resolution  interorganisationnelle  des  problemes  :  ‘La  resolution  de  problemes  dans 
diverses  structures  organisationnelles’;  ‘Les  modeles  de  prise  de  decision’;  ‘Les  methodes  de 


2  Dre.  Lemyre  est  la  titulaire  de  la  Chaire  de  recherche  McLaughlin  sur  le  risque  psychosocial,  Directrice  de 
GAP-Sante  a  l’Institut  de  sante  des  populations,  et  Professeure  a  l’Ecole  de  psychologie,  Faculte  des 
sciences  sociales,  Universite  d’Ottawa. 
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prise  de  decision’;  ‘Le  temps’;  ‘Les  ressources’;  ‘La  complexite’  et  ‘Les  etudes  de  cas’.  34 
rapports  predefinis  ont  ete  ajoutes  a  la  base  de  donnees,  selon  ces  categories.  Plusieurs  options 
sont  egalement  disponibles  pour  ce  qui  est  d’imprimer  les  rapports. 

La  Tache  5  conclut  le  projet  de  Recherche  par  la  simulation  in  vivo  sur  la  prise  de  decision 
partagee  des  metaorganisations.  Bien  que  la  base  de  donnees  sur  laquelle  porte  ce  rapport 
contienne  un  nombre  important  d’articles  scientifiques  revises  par  des  pairs,  de  rapports  et 
d’autres  types  de  references  bibliographiques  liees  a  la  prise  de  decision  partagee,  des  etudes 
supplementaires  sont  necessaires  afin  d’aboutir  a  une  comprehension  plus  complete  des 
implications  du  Modele. 
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Preface 


This  document  represents  the  final  draft  of  Task  5:  Creation  of  a  user  friendly  knowledge  tool, 
and  is  submitted  using  the  DRDC  supplied  template  for  Contractor  reports.  The  work  has  been 
completed  for  Defence  Research  and  Development  Canada  (DRDC)  as  part  of  the  contract 
deliverable  defined  in  the  project  entitled  Research  Using  In-Vivo  Simulation  of  Meta- 
Organizational  Shared  Decision  Making  (SDM),  Contract  No.:  W7714-083659/001/SV.  As  per 
contract  requirements,  the  document  is  provided  in  both  electronic  format  and  printed  copy  (5). 

The  completion  of  the  Task  5  report  which  describes  the  knowledge  database  tool  and  the 
handover  of  the  knowledge  tool  application  represent  the  final  deliverables  of  this  research 
project.  The  research  undertaken  so  far  has  opened  up  a  number  of  additional  lines  of  inquiry  that 
have  the  potential  to  extend  the  benefits  achieved  to-date  should  research  proceed  in  these  areas. 
Suggestions  and  considerations  related  to  future  research  opportunities  have  been  outlined  in  the 
Task  4  report. 

Document  Distribution  and  Confidentiality 

Document  distribution  and  confidentiality  protocols  as  specified  in  the  contract  noted  above  will 
apply  to  this  document.  Please  contact  Dr.  Louise  Lemyre,  Principal  Investigator,  University  of 
Ottawa,  at  louise.lemyre@uOttawa.ca  should  a  change  in  protocols  be  requested.  Please  quote 
with  due  reference  to  Lemyre  et  al.  2010,  Report  on  Research  Using  in  Vivo  Simulation  of  Meta- 
Organizational  Shared  Decision  Making  (SDM)  -  Task  5:  Creation  of  a  user  friendly  knowledge 
tool. 
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1  Introduction 


1.1  Purpose  and  structure  of  report 

According  to  the  overview  of  the  Technology  Innovation  Fund  (TIF)  project  (Chouinard,  2009), 
the  Canadian  Forces  (CF)  have  become  increasingly  involved  with  complex  events  that  defy  easy 
solutions.  Complex  events  result  in  ripple  effects  that  extend  beyond  immediate  impacts,  and  are 
exacerbated  by  existing  vulnerabilities  and  by  the  uncertainties  inherent  in  large  scale  threats  and 
emergencies.  As  the  effects  of  these  events  are  mitigated,  the  CF  must  engage  with  traditional, 
non-traditional,  and  international  partners  to  collaborate  on  and  contribute  to  solutions  to 
challenging  problems.  The  TIF  project  was  implemented  with  the  overall  goal  of:  assisting  the 
CF  and  partnering  agencies  through  an  understanding  of  interagency  collaborative  behaviour, 
the  effects  of  inter-agency  relationships  on  collective  decision  making  and  the  influences  of 
psycho-social  factors.  (Chouinard,  2009,  p.2) 

The  current  research,  Research  Using  In  Vivo  Simulation  of  Meta-organizational  Shared  Decision 
Making,  was  designed  to  support  the  TIF  goal  via  completion  of  five  specific  tasks.  This  draft 
report  presents  the  results  of  Task  5:  Creation  of  a  user  friendly  knowledge  tool.  Task  1  focused 
on  project  conceptualization,  a  review  of  the  relevant  literatures,  and  a  series  of  Canadian  and 
international  cases,  culminating  in  the  development  of  the  Model  for  Inter-organizational 
Problem-solving.  This  Model  served  as  the  shared  decision-making  framework,  providing  the 
theoretical  basis  for  the  remaining  tasks.  Task  2  involved  the  development  of  a  research  plan  for 
an  in  vivo  simulation  experiment  and  qualitative  interviews,  both  of  which  were  then 
implemented  under  Task  3.  Task  4  focused  on  analysing  the  findings  from  the  various  data 
sources  and  methods  implemented  in  previous  tasks  to  develop  potential  considerations  and 
guidelines  with  respect  to  communication,  decision-making  and  problem-solving  in  multi- 
organizational  environments  during  extreme  events.  Task  5,  the  topic  of  the  present  report  and  the 
final  task  of  the  research  project,  involved  the  development  of  a  user-friendly  database  that  will 
help  direct  individuals  to  key  sources  and  references  for  each  of  the  main  concepts  and  constructs 
used  throughout  the  research  process. 

The  following  section  describes  the  knowledge  database  tool  in  terms  of  its  purpose,  structure, 
information  sources,  accessing  and  viewing  the  database,  and  running  pre-defined  reports. 
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2  Description  of  the  Knowledge  Database  Tool 


2.1  Purpose 

As  described  in  the  Statement  of  Work  for  the  project,  the  objective  of  Task  5  is  to  “ provide 
guidance  for  the  operational  and  the  supporting  analytic  communities  through  a  software-based, 
user  friendly  knowledge  database  tool  based  upon  MS  Access.  The  tool  must  provide  these 
communities  with  access  to  the  SDM  framework  recommendations  for  shared  decision  making, 
where  there  are  differences  between  the  SDM  framework  and  the  ICS  framework,  insight  into  the 
limitations  of  these  frameworks,  suggestions  to  overcome  the  limitations  in  what  circumstances 
and  any  other  insights  that  result  from  the  research.'’’’ 

As  detailed  below,  the  information  in  the  database  is  organized  by  the  key  elements  of  the  Shared 
Decision-Making  (SDM)  framework.  The  reports  produced  under  Task  1  through  Task  4 
activities  are  themselves  parsed  and  coded  for  easy  access  to  recommendations  and  observations 
not  only  on  the  SDM  framework  but  also  on  the  ICS  model  and  other  decision  making  models 
examined  during  the  course  of  the  project. 

2.2  Database  structure 

The  organizing  principle  used  to  construct  the  database  is  the  Model  for  inter-organizational 
problem  solving  described  in  Task  1  of  the  Research  Using  In-Vivo  Simulation  of  Meta- 
Organizational  Shared  Decision  Making  (SDM)  project  (see  Figure  1  below). 


Situation  Moderators  Interorganizational 

Approach 


Figure  1:  Model  for  inter-organizational  problem  solving 
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The  conceptualization  of  the  Model  aimed  at  gaining  an  understanding  of  inter-organizational 
problem  solving  during  extreme  events  (Lemyre  et  al.,  20 103).  As  illustrated  in  the  previous 
figure,  the  Model  suggests  that  an  optimal  approach  to  inter-organizational  problem  solving  must 
take  into  account  the  following  two  major  components:  situational  complexity  (described  as 
‘Simple’,  ‘Complicated’  or  ‘Complex’)  and  inter-organizational  approach  (i.e.,  ‘Coordination’, 
‘Cooperation’  and  ‘Collaboration’).  The  Model  provided  inspiration  for  six  of  the  main  reference 
categories  that  are  found  in  the  database.  These  categories  consist  of:  1)  Problem  solving  in 
various  organizational  structures,  2)  Decision-making  models,  3)  Problem-solving  approaches,  4) 
Time,  5)  Resources,  and  6)  Complexity.  ‘Case  studies’  was  added  as  a  7th  category  to  incorporate 
the  nine  case  studies  documented  in  the  Task  1  report.  Each  of  these  seven  categories  is  broken 
down  into  a  number  of  sub-categories,  as  depicted  in  the  figure  below: 
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•  Meta¬ 
organisations 

•  Public 

administration/ 
Public  policy 
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development/N 
COS 
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•  Private  sector 


2.  Decision 

making 
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making  models 
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decision¬ 
making 

•Organisational 
models  of 
decision¬ 
making 


3.  Problem 

Solving 

Approaches 

•Problem 

solving 

approaches 
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•  Time  (General) 
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management 

•  Risk 

management 

•Consequence 

management 


5.  Resources 

•  Resources 
(General) 
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Technology 

•Power/ 

Aulhoiily 


6.  Complexity 

•Complexity 

(General) 

•  Uncertainty 
•Vulnerability/ 
Resilience 
•Impact 


7.  Case  Studies 

•  Eastern  Canada 
Ice  Storm 
(1998) 

•  Red  River 
Floods  (1997) 

•  Kelowna  Files 
(2003) 

-SARS  (2003) 

•Gander, 

Operation 

Sleepover 

(2001) 

*Blackuul(2003) 

•Hurricane 
Katrina  (2005) 

•  London 
Bnmhing(7005) 

•  Tsunami  (2004) 
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Figure  2:  Database  categories 


3  Lemyre,  L.,  Boutette,  P.,  Pinsent,  C.,  Cornell,  W.,  Johnson,  C.,  Munoz,  M.  et  al.  (2009).  Research  Using 
In  Vivo  Simulation  of  Meta-Organizational  Shared  Decision  Making  (SDM):  Task  1:  Synthesis  of  Case 
Studies  to  form  a  SDM  framework. 
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A  total  of  479  references  are  included  in  the  knowledge  database  tool  and  are  organized  by  one  or 
more  of  the  categories  listed  above.  For  a  full  list  of  the  references  included  in  the 
knowledge  database  tool,  see  Annex  A. 


2.3  Building  the  database  of  information  sources 

The  foundation  of  the  database  lies  in  the  references  listed  in  the  previous  tasks  of  the  Research 
Using  In-Vivo  Simulation  of  Meta-Organizational  Shared  Decision  Making  (SDM)  project 
(Tasks  1-4).  However,  given  that  research  is  on-going,  a  number  of  references  are  included  that 
were  not  alluded  to  in  the  previous  contract  reports  of  this  project.  These  references  relate  to  grey 
literature  and  peer-reviewed  articles,  as  well  as  material  from  prior  research  undertaken  by  the 
GAP-Sante  research  team.  Segments  of  the  contract  reports  themselves  are  also  referred  to  in  the 
database  allowing  users  quick  access  to  salient  points  made  in  one  or  more  of  the  Task  reports. 

The  articles  retained  for  database  creation  purposes  had  to  relate  to  at  least  one  of  the  sub¬ 
categories  listed  earlier.  In  many  cases,  references  related  to  multiple  categories  and  judgements 
were  made  to  document  accordingly.  As  an  aid  in  this  process,  the  sub-elements  of  the  Model, 
where  relevant,  were  reviewed  to  determine  “best  fit”  of  a  specific  article  or  piece  of  information. 
Refer  to  Figure  3  below  for  sub-elements  of  the  factors  contributing  to  situational  complexity. 


Figure  3:  Three  factors  contributing  to  situation  complexity 
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The  references  chosen  for  inclusion  were  initially  entered  into  Reference  Manager  vl2,  a 
bibliographic  software  tool  utilised  during  the  course  of  the  various  literature  searches  undertaken 
in  completing  the  project.  The  references  were  subsequently  coded  with  keywords  referring  to 
one  or  more  of  the  categories  presented  in  Figure  2.  During  this  process,  all  abstracts  available 
were  obtained  and  inserted  in  the  relevant  fields.  Approximately  half  of  the  references  either  did 
not  have  abstracts  written  for  them  or  the  abstracts  were  inaccessible.  URLs  were  also  provided 
when  available,  in  order  to  create  ease  of  access  to  original  sources  of  information.  With 
information  in  Reference  Manager  updated  and  coded  as  per  the  categories  and  sub-categories 
described  above,  the  data  was  exported,  as  an  interim  step,  to  an  MS  Excel  spreadsheet  to 
facilitate  the  final  organization  and  cleaning  of  the  data.  A  select  number  of  bibliographic  fields 
were  marked  for  inclusion  in  the  database  knowledge  tool  and  the  rest  deleted.  (Refer  to  Annex  B 
for  list  of  types  of  information  identified  for  inclusion.)  The  ‘embellished’  version  of  the 
references  was  then  exported  to  MS  Access. 


2.4  Accessing  and  viewing  the  database 

To  limit  compatibility  issues  and  provide  widest  possible  dissemination,  the  knowledge  database 
tool  has  been  formatted  to  run  with  MS  Access  2002-2003.  Users  with  later  versions  of  MS 
Access  should  be  able  to  open  and  view  the  data.  The  tool  has  been  designed  for  users  with  little 
or  no  previous  experience  with  MS  Access.  It  is  assumed  though  that  users  will  be  familiar  with 
standard  navigation  and  print  functions  in  MS  Office  applications,  such  as  MS  Word  or  MS 
Excel.  These  functions  are  not  explained  in  any  detail  in  the  information  provided  below. 

The  database  contains  a  total  of  34  reports,  each  related  to  one  of  the  major  categories  of 
information.  Refer  to  Table  1  below. 


Table  1:  Report  Descriptions 


Report  Category 

Report  Description 

List  of  the  references  related  to  Problem-solving 
in  various  organizational  structures: 

Contains  all  the  references  related  to  problem 
solving  in  various  organizational  structures.  These 
structures  contain  the  six  following  sub-categories: 

Al)  ICS,  A2)  Meta-organisations,  A3)  Public 
Administration/Public  policy,  A4)  Community 
Development/NGOs,  A5)  Inter-jurisdictional/Whole- 
of-govemment  approaches  and  A6)  Private  Sector. 

List  of  the  references  related  to  Decision-making 
models: 

Contains  all  the  references  related  to  decision¬ 
making  models,  broken  down  into  the  four  following 
sub-categories:  Bl)  Models  of  Decision-making 
(General),  B2)  HROs/Learning  Organizations,  B3) 
Individual  Models  of  Decision-making  and  B4) 
Organisational  Models  of  Decision-making. 

List  of  the  references  related  to  Problem-solving 
approaches: 

Contains  all  the  references  related  to  problem 
solving  approaches.  The  four  sub-categories  of  this 
report  are:  Cl)  Problem  Solving  Approaches 
(General),  C2)  Collaboration,  C3)  Cooperation  and 

C4)  Coordination. 

List  of  the  references  related  to  Time: 

Contains  all  the  references  related  to  time  and  time 
phases.  These  references  are  categorized  according 
to:  Dl)  Time  (General),  D2)  Crisis  Management, 
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D3)  Risk  Management  and  D4)  Consequence 
Management. 

List  of  the  references  related  to  Resources: 

Contains  all  the  references  related  to  resources.  The 
three  sub-categories  of  this  report  are:  El) 

Information,  E2)  Resources  and  E3) 

Power/ Authority. 

List  of  the  references  related  to  Complexity: 

Contains  all  the  references  related  to  complexity  and 
Complexity  Theory,  separated  into:  FI)  Complexity 
(General),  F2)  Uncertainty,  F3) 
Vulnerability/Resilience  and  (4)  Impact. 

List  of  references  related  to  Case  studies: 

Gl)  Eastern  Canada  Ice  Storm  (1998) 

G2)  Red  River  Floods  (1997) 

G3)  Kelowna  Fires  (2003) 

G4)  SARS  (2003) 

G5)  Gander,  Operation  Sleepover  (2001) 

G6)  Blackout  (2003) 

G7)  Hurricane  Katrina  (2005) 

G8)  London  Bombing  (2005) 

G9)  Tsunami  (2004) 

Once  the  knowledge  database  tool  has  been  launched,  users  will  be  able  to  view  information 
either  by  “Report  Category”  or  by  “Form  View”.  The  Report  Categories  screen  (pictured  below) 
provides  access  to  all  of  pre-defined  reports  created  for  the  purpose  of  the  database  tool.  In  order 
to  open  the  reports,  the  user  simply  clicks  on  the  appropriate  button  located  to  the  right  of  the 
report  title.  The  report  titles  correspond  to  the  previously  defined  category  labels.  Selecting  a 
report  category  (e.g.,  Problem-solving  approaches:  Collaboration)  will  automatically  display  all 
of  the  linked  references. 


Figure  4:  Report  Category  Screen  Screenshot 
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The  “Form  View”  allows  the  user  to  navigate  through  the  bibliographic  references  by  viewing 
them  individually.  Each  “Form”  represents  one  bibliographic  reference  from  the  list  of  references 
related  to  a  particular  category.  The  specific  category  of  information  is  displayed  in  the  title  of  the 
form.  (Refer  to  Figure  5  below  for  an  example  of  a  Form  screenshot.) 


23  G6  -  Blackout  Form 

fn  Case  Study  -  Blackout  (2003) 
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Author(s) 

Year 

Web  URL 
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IEEE  Transactions  on  Power  Systems 
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Figure  5:  Example  of  a  Form  Screenshot 

The  steps  outlined  below,  provide  specific  instructions  on  opening  the  database,  viewing 
information  either  by  “Report  Category”  or  by  “Form  View”,  running  and  printing  reports  and 
customizing  the  database. 
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Opening  the  knowledge  database  tool 


1 .  Double-click  on  the  knowledge  database  tool  icon  labelled  “DRDC  SDM  Knowledge 
Tool ” 

The  Report  Categories  screen  form  appears  (see  Figure  6  below).  All  four  tabs  in  the 
navigation  pane  at  the  left  of  the  screen  (‘Tables’,  ‘Queries’,  ‘Forms’  and  ‘Reports’)  are 
minimized. 


% 


nhif|<'«8  lyj  ? 


Viewing  reports  using  the  Report  Categories  screen  form 

Note:  The  Report  Categories  screen  provides  a  visual  display  of  all  of  the  reports 
available  to  the  user.  If  Open  is  clicked  for  a  particular  report,  the  report  will  run  over  the 
Report  Categories  screen.  The  Report  Categories  form  will  remain  opened  in  the 
background,  accessible  for  the  user  to  return  to  it  at  all  times  by  clicking  on  its  label. 
Users,  alternatively,  can  also  access  all  the  reports  using  the  Report  navigation  pane  as 
described  later  below. 
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1 .  With  the  Report  Categories  screen  open,  click  on  the  Open  button  for  the  choice  of 
category.  If  the  report  contains  multiple  records,  you  can  use  the  scroll  function  to  view 
the  records.  Refer  to  Figure  7  below  for  an  example  of  a  report  screen. 
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Figure  7:  Example  of  a  report ’s  first  page  (Print  Preview) 


As  illustrated  in  the  screenshot  above,  each  report  is  structured  according  to  the  same 
template.  With  the  exception  of  the  ‘Ref  ID’  field,  all  the  bibliographic  fields  listed  in 
Annex  B  appear  on  the  reports.  The  first  page  of  each  report  begins  with  the  title  of  the 
report  (e.g.,  A)  list  of  references  related  to  problem  solving  in  various  organizational 
structures:  A1  (ICS,  with  a  grey  backdrop).  Individual  records  alternate  between  white 
and  grey  backdrops.  Pages  are  numbered. 
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2.  To  view  records  related  to  another  report  category,  return  to  the  Report  Categories 
form  by  clicking  on  the  ‘  1  -  Report  Categories’  label  and  click  on  the  appropriate  Open 
button  next  to  the  desired  report  title.  Refer  to  Figure  8  below  for  location  of  Report 
Categories  label. 
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Figure  8:  Location  of  Report  Categories  form 


Viewing  reports  using  the  Reports  navigation  pane 

Users  can  access  and  view  reports  using  the  Reports  navigation  pane.  Reports  are  labelled 
beginning  with  a  capital  alpha  character  (e.g.,  C  for  list  of  references  related  to  problem 
solving  approaches)  followed  by  the  number  of  the  sub-grouping  and  title  (e.g.,  C3- 
Cooperation). 
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1 .  If  not  already  open,  click  on  the  Report  tab  to  view  the  list  of  reports  available. 
Double-click  on  the  report  you  wish  to  view.  Refer  to  Figure  9  below. 
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Figure  9:  Report  navigation  pane 
Viewing  records  in  Form  View 

As  previously  mentioned,  the  user  may  also  view  all  of  the  records  entered  into  the 
knowledge  database  tool  using  Form  View.  These  records  are  displayed  one  at  a  time. 

1 .  If  not  already  open,  click  on  the  Forms  tab  to  view  the  list  of  forms  available. 

2.  Double  click  on  the  title  of  the  Form  you  wish  to  view  (e.g.,  Al-ICS  form).  The  first 
record  in  the  ICS  grouping  will  display.  Refer  to  Figure  10  below. 

Note:  The  number  of  references  or  records  related  to  the  selected  category  is  displayed 
near  the  bottom  left  comer  of  the  form.  For  example,  as  shown  in  Figure  10,  there  are  15 
references  relating  to  the  ICS  grouping.  Use  the  ‘advance  arrow’  at  the  bottom  of  the 
screen  to  display  the  next  record.  The  user  may  search  through  the  forms  relating  to  a 
particular  category  by  typing  keywords  (i.e.:  author  name)  in  the  search  bar  located  at  the 
bottom  of  the  form. 
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Combining  structural  forms  in  the  search  for  policy  tools:  Incident  command  systems  in  US  crisis 


2008 


Web/URL  |  ISI:Q00254989700005 
Source 


As  governments  search  for  policy  tools  to  deliver  public  services,  two  choices  -  hierarchy  or  network  -  A 
are  portrayed  as  stark  alternatives  The  U.S.  Department  of  Homeland  Securin' has  adopted  a 
practitioner-based  innovation  known  as  the  Incident  Command  System  (ICS)  that  assumes  that  crises 
require  a  network  of  responders,  but  that  these  nenvorks  should  be  managed  by  a  hierarchy.  While  the  v 
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Figure  10:  Example  of  an  ICS  record  Form  View 

2.5  Printing  reports 

To  print  a  report,  the  user  must  select  the  ‘File’  tab  located  at  the  top-left  of  the  screen,  and  then 
click  on  the  ‘Print’  tab.  Before  printing,  the  user  may  view  the  Print  Preview  version  by  right- 
clicking  on  the  report  (in  Report  View)  and  selecting  ‘Print  Preview’. 

2.6  Customizing  reports 

In  order  to  help  augment  the  power  of  the  tool,  as  well  as  keep  it  up  to  date,  DRDC  has  been 
provided  with  an  unlocked  version  of  the  tool.  Users  have  the  option  of  customizing  the  database 
in  two  ways  as  described  below.  Only  the  major  steps  have  been  highlighted  with  appropriate 
screenshots. 

1)  Users  may  add  a  record  linked  to  one  of  the  categories  of  the  Model  for  Inter-organizational 
Problem  Solving; 

2)  Users  may  create  a  new  category  of  records  and  populate  it. 

Note:  The  knowledge  tool  is  a  live  database.  In  order  to  prevent  losing  data  during  the 
customization  process,  we  highly  recommend  that  users  save  a  backup  copy  of  the  database 
before  making  any  modifications  to  the  file. 
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Adding  a  record  to  one  of  the  categories  of  the  Model 


1 .  If  not  already  opened,  click  on  the  Tables  tab  in  the  navigation  pane  to  view  the  list  of 
tables  available. 

2.  Double-click  on  the  ‘References’  table  to  open  it. 

3.  Scroll  down  to  the  bottom  of  the  table.  The  next  available  field  is  indicated  by  the  word 
‘(New)’  in  the  Reference  ID  field,  and  an  asterisk  on  the  left-hand  side  of  the  screen  (see 
Figure  1 1).  As  the  user  begins  typing  information  in  the  remaining  fields,  a  new  reference 
number  appears  in  the  Reference  ID  field. 


TH  References 

Ref  ID  »  Ref  Type  »  Title  »  Author(s)  * 

Year  *  Web/URL 

Source 

467  RPRT 

Disaster  myths  and  realities  Wachtendorf  1 

2007  http://www.riskinstitute.orB/PERl/TRAINING/ 

N/A 

468  BOOK 

Strengthening  Family  Resilience  Walsh  F; 

2003 

Publisher:  The  N/A 

469  ELEC 

Home  Depot  prepares  for  Katrina  Ward  A; 

2005  htto://www.ft.com/cms/s/0/2e968i06-1829-llda-al< 

N/A 

470  ELEC 

Crisis  communications  remain  flawed  Warrick  J; 

2005  htto://www.washinBtonpost.com/wD-dvn/content/e 

N/A 

471  JOUR 

Collective  mind  in  organizations:  Heedful  interrelating  c  Weick  KEjRobe 

1993 

Administrative  The  concept 

472  ELEC 

Social  Media  in  Times  of  Crisis:  Mumbai  Wesgerber  C; 

2009  htto://mvweb.stedwards.ed/corinnew 

N/A 

473  JOUR 

Don't  panic!  Short  and  long  term  psychological  reactions  Wessely  S; 

2005 

Journal  of  Mer  The  possibil 

474  JOUR 

Blackout:  Solutions  that  won't  cost  a  fortune  White  D;  Rose! 

2003 

The  Electrical  J  N/A 

475  JOUR 

Early  detection  of  disease  outbreaks  using  the  Internet  Wilson  K;Brow 

2009 

CAMJ  Rapidly  ider 

476  ELEC 

India  rural  governments  and  service  delivery,  volume  II:  World  Bank; 

2006  http://www.un.org 

N/A 

477  CONF 

Supporting  Collaborative  Sensemaking  in  Map-Based  Err  Wu  A;Zhang  X; 

2009 

N/A 

478  CONF 

Cultural  and  institutional  conditions  for  high  reliability  t>  Xiao  Y;  Plaster: 

2004 

Proceedings  fr  What  prope 

479  JOUR 

Epidemiologic  Clues  to  SARS  Origin  in  China  Xu  RH;  He  JF;  E 

2004 

Journal  of  Erne  An  epidemii 

480  CHAP 

Resiliency  development  of  organizations,  leaders  and  er  Youssef  CM;Lu 

2005 

Authentic  Leac  N/A 

481  JOUR 

Task  Cohesion  As  A  Facilitator  of  Team  Decision-Making  Zaccaro  SJ;Gua 

1995  ISI:A1995RZ87500003 

Military  Psychi  In  this  study 

482  NEWS 

Gander,  the  little  town  that  opened  its  heart:  More  than  Zacharias  Y; 

2002 

The  Vancouvei  Newfoundk 

483  CONF 

Supporting  Collaborative  Sensemaking  in  Map-Based  Err  Zhang  X; 

2009 

N/A 

484  BOOK 

The  Resilient  Enterprise  Sheffi  Y; 

2007 

Publisher:  MIT  What  happe 

486  RPRT 

Research  Using  in  Vivo  Simulation  of  Meta-Organization:  Lemyre  L;  Pins 

2011 

N/A 

487  RPRT 

Research  Using  in  Vivo  Simulation  of  Meta-Organization:  Lemyre  L;  Pins 

2011 

N/A 

488  RPRT 

Research  Using  In  Vivo  Simulation  of  Meta-Organization:  Lemyre  L;  Pins 

2011 

N/A 

490  RPRT 

Research  Using  In  Vivo  Simulation  of  Meta-Organization:  Lemyre  L;Bout 

2009 

introductior 

491  RPRT 

Research  Using  In  Vivo  Simulation  of  Meta-Organization:  Lemyre  L;Bout 

2009 

Introductior 

492  RPRT 

Research  Using  In  Vivo  Simulation  of  Meta-Organization:  Lemyre  L;Bout 

2009 

Introductior 

(New) 

Figure  11:  New  Field  in  ‘References  ’  Table 


4.  In  order  to  link  the  new  record  added  to  categories  of  the  Model,  the  user  must  scroll  to 
the  right  (using  the  scrollbar  located  at  the  bottom  of  the  screen)  until  he/she  is  able  to 
view  the  ‘Yes/No’  type  columns  relating  to  each  sub-category  of  the  database.  The 
‘References’  table  contains  34  fields  relating  to  the  sub-categories  illustrated  in  Figure  2, 
beginning  by  ‘ICS’  and  ending  with  ‘Tsunami’  (see  Figure  12). 
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Figure  12:  Report  ‘Yes/No  ’  Type  Sub-Category  Fields 


By  default,  all  the  sub-category  fields  related  to  the  newly  entered  records  will  read  ‘No’ 
(Value  =  0),  indicating  that  they  are  not  linked  to  any  category.  Users  must  enter  ‘+1’  in 
the  column  of  each  field  they  wish  to  link  the  new  record  to.  Modified  columns  reading 
‘Yes’  will  then  appear  in  the  related  predefined  forms  and  reports. 

5.  Repeat  these  five  steps  for  each  new  record  to  be  added. 

Creating  a  new  category  of  records 

1 .  If  not  already  opened,  click  on  the  Tables  tab  in  the  navigation  pane  to  view  the  list  of 
tables  available. 

2.  Double-click  on  the  ‘References’  table  to  open  it. 

3.  Right-click  on  the  table’s  label  and  select  ‘Design  View’. 

4.  In  Design  View,  scroll  to  the  bottom  of  the  list  of  field  names  and  enter  the  name  of  the 
new  category  in  the  next  available  field.  In  the  ‘Data  Type’  Column,  select  ‘Yes/No’. 
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Figure  13:  References  Table  (Design  View) 


5.  Right-click  on  the  table’s  label  and  select  ‘Datasheet  View’.  Follow  the  steps  described 
in  the  previous  section  to  add  a  new  record,  and  link  it  to  the  desired  category(s). 

6.  Create  a  filtered  query  based  on  the  new  category. 
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Figure  14:  Example  of  a  filtered  query  -  Case  Study:  Blackout  Query 


7.  Create  a  form  based  on  the  filtered  query.  Refer  to  predefined  forms’  design  in  Design 
View  for  an  example  of  a  template  to  follow. 


After  following  the  seven  previous  steps,  users  will  be  able  to  create  a  new  report,  or  series  of 
reports  based  on  their  category(s)  of  choice.  Refer  to  predefined  reports’  design  in  Design  View  for 
an  example  of  a  template  to  follow.  Users  may  also  modify  the  design  of  the  Report  Categories 
form. 
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Abstract 

Introduction:  This  report,  along  with  an  accompanying  knowledge  database  tool,  represents 
completion  of  Task  5  of  the  work  stream  “Research  Using  in  Vivo  Simulation  of  Meta- 
Organizational  Shared  Decision  Making  (SDM)”,  one  component  of  the  Technology 
Innovation  Fund  (TIF)  program  on  Meta- organizational  Collaboration  that  has  been  designed 
to  assist  in  understanding  challenges  faced  by  the  Canadian  Forces  (CF).  The  objective  of  the 
stream  is  to  conduct  basic  research  into  shared  decision  making  through  the  analysis  of  case 
studies,  exercises  and  simulations. 

Method:  Task  5  involved  the  development  of  a  knowledge  database  tool  organised  by  the 
various  components  of  the  shared-decision  making  (SDM)  framework  entitled  Model  of 
Inter-Organizational  Problem  Solving.  The  database  tool  purpose,  organization  and  features 
are  described  in  this  report. 

Results  and  Discussion:  During  research  undertaken  to  develop  the  Model  for  Inter- 
organizational  Problem  Solving  (Task  1)  and  the  design  and  implementation  of  an 
experimental  plan  to  test  the  Model  (Tasks  2  and  3),  a  body  of  literature  was  collected  and 
referenced  in  the  various  Task  reports.  Additional  peer-reviewed  articles  and  grey  literature 
were  consulted  for  the  purpose  of  completing  Task  4:  Modeling  communication  and  decision 
making  functions.  This  knowledge  base  of  information  sources  has  been  organized  in  MS 
Access  by  the  key  components  of  the  Model  for  ease  of  use  by  the  operational  and  analytic 
communities  within  DRDC. 

Resume 

Introduction  :  Ce  rapport  presente  la  Tache  5  du  projet  «  Recherche  par  la  simulation  in- 
vivo  sur  la  prise  de  decision  partagee  des  meta-organisations  »,  une  composante  du 
programme  de  recherche  sur  les  meta-organisations  finance  par  le  Fond  pour  F  innovation 
technologique  (Technology  Innovation  Fund  -  TIF),  mis  en  place  afm  d’ameliorer  la 
comprehension  des  defis  auxquels  font  face  les  Forces  canadiennes  (FC)  en  matiere  de 
collaboration  inter-organisationnelle.  L’objectif  de  ce  projet  est  de  mener  une  recherche 
fondamentale  sur  la  prise  de  decision  partagee,  au  moyen  d’etudes  de  cas,  d’exercices  et  de 
simulations. 

Methode  :  La  Tache  5  consiste  en  la  creation  d’un  outil  de  connaissance  sous  forme  de  base 
de  donnees  organisee  selon  les  elements  du  modele  de  prise  de  decision  partagee  nomme 
Modele  de  la  resolution  inter-organisationnelle  de problemes.  L’objectif,  la  structure  ainsi 
que  les  caracteristiques  de  cet  outil  sont  decrits  dans  ce  rapport. 

Resultats  et  discussion  :  Au  cours  de  la  recherche  entreprise  dans  le  but  de  developper  le 
Modele  de  la  resolution  inter-organisationnelle  de  problemes  (Tache  1)  et  la  conception  ainsi 
que  la  mise  en  oeuvre  du  plan  experimental  servant  a  tester  le  Modele  (Taches  2  et  3),  un 
important  coipus  de  litterature  a  ete  recueilli  et  cite  dans  les  rapports  des  differentes  Taches. 
Des  articles  scientifiques  additionnels  et  des  rapports  ont  ete  consultes  afm  de  completer  la 
Tache  4  intitulee  :  Modelisation  des  fonctions  de  communication  et  de  prise  de  decision.  Ces 
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sources  d’information  ont  ete  organisees  dans  le  logiciel  MS  Access  d’apres  les  composantes 
cles  du  Modele,  de  maniere  a  pouvoir  etre  facilement  consultees  et  manipulees  par  le 
personnel  de  RDDC. 
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